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ABSTRACT 

This Note describes several versions of an 
intelligent tutor for basic algebra that have been developed at the 
RAND Corporation. The versions of the tutor were built around several 
core components, including an algebra expert system and a student 
modeling component that can make inferences about misconceptions 
underlying students* errors. The different versions help students 
learn distinct kinds of mathematical reasoning skills. The first 
discussion concerns the equation-solving tutor, which focuses on the 
acquisition of relatively low-level symbol manipulation skills. Next, 
the model-building tutor which helps students acquire important 
mathematical reasoning skills that are no • part of most algebra 
curricula, including the ability to formulate a mathematical model of 
real-world situations and to test mathematical hypotheses, is 
discussed. This document concludes with a dd^cussion of the 
implications of the tutors for curriculum change. The pedagogical 
approach implicit in the tutors diverges from most classroom teaching 
principals, l.^. "embedded" and "global-before-local" practice is 
advocated. (Author/CW) 



* Reproductions supplied by EDRS are the best that can be made 
" from the original document. 
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Preface 



For ihc past three years, the Algebra Tutor Project has been developing and field testing 
an intelligent computer tutor for basic algebra. This Note, originally published in the 
January/Febmary 1989 issue of Technology and Learning (Vol. 3. No. 1). discusses different ver- 
sions of the tutor. 

This research was supported by a grant from the National Science Foundation's Director- 
ate for Science and Engineering Education (Application of Advanced Technologies Program). 

Additional reports on the Algebra Tutor Project, listed below, can be obtained from The 
RAND Corporation's Publications Department: 



D. McArthur. C. Stasz, and J. Y. Hotta, Learning Problem Solving Skills in Algebra, The 
RAND Coiporation, N.2595-NSF, May 1987 

D. McArthur. C. Burdorf, T. Ormseih, A. Robyn. and C. Stasz, Multiple Representations 
of Mathematical Reasoning, The RAND Corporation, N-2758-NSF/RC, May 1988. 

D. McArthur, C, Stasz. J. Hotta, 0. Peter, and C. Burdorf, Skill-Oriented Task Sequencing 
in an Intelligent Tutor for Basic Algebra, The RAND Corporation, N.2966-NSF, June 
1989. 
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Summary 

This Note describes several versions of an intelligent tutor for basic algebra that we have 
been developing at RAND over the past three years. The versions of the tutor are built around 
several "core" components, including an algebra expert system and a student modeling com- 
ponent that can make inferences about misconceptions underlying students* errors. The different 
versions help students learn di^.iinct kinds of mathematical reasoning skills. We first discuss the 
equation-solving tutor, which focuses on the acquisition of relatively "low-level" symbol manipu- 
lation skills. Then we review the model-building tutor, a recent version that helps students ac- 
quire important matlicmatical reasoning skills that are not part of most algebra curricula, includ- 
ing the ability to formulate a mathematical model of real-world situations and to test mathemati- 
cal hypotheses. The Note concludes with a discussion of the implications of the tutors for curri- 
culum change. We note how the pedagogical approach implicit in our tutor diverges from most 
classroom teaching principles. While traditional classrooms often engage in isolated and 
bottom-up practice, we advocate embedded and global-before-local practice. 
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Over the last three years we have been building a coUcciion of intelligent tutoring sys- 
tems and tools to help students learn basic algebra. The various versions of the algebra tutor 
have been tested in the lab and in the classroom as part of algebra courses a: a local high school. 
Common to all versions of the tutor is a set of modules constructed using ideas from artificial in- 
telligence and expert-systems technology, which give the different versions much of their 
human-like intelligence. In particular, common lo each of the versions are: An algebra expert 
system that solves and can explain its solutions lo problems in basic symbolic algebra using rea- 
soning steps that students can understand; a student modeling component that can make infer- 
ences about the misconceptions underlying many of ihc students* overt errors; and a task 
sequencing component that can decide which concepts the student should learn next on the basis 
of inferences about students* past performance in the student model. The task sequencing com- 
ponent then generates problems that embody those concepts. (See McArthur, Stasz, and Hotta 
(1987) for more information on the algebra tuior versions. McArthur, Stasz, Hotta, Peter, & Bur- 
dorf (1988) contains a detailed discussion of task sequencing.) 

We specifically designed the different versions of the tutor to support students* learning 
of distinct kinds of mathematical thinking skills. Our designs are based on several principles: 

• Articulation. We begin with an analysis that uncovers or articulates the diffeftnt kinds of 
skills involved in a particular type of maLhcmaiical expertise. Often articulation uncovers 
several kinds of tacit knowledge that even teachers are not aware students need to learn. 

• Reification. We then design software tools that are specifically designed to reify each of 
these skills (Collins, Brown, & Newman, 1988). Reiflcation means making visible and ex- 
plicit a skill or activity that is often hidden and implicit - as mathematical reasoning often 
is. 

• Coaching and supports. The software tools wc construct range from coaches that actively 
tutor Uie student in the skills and reasoning that arc the topic of the particular tutor version, 
to more passive supports. Supports do not coach the students but rather prnvute iriiomia- 
tion and tools that afford them opportunities to Icam effectively by thenisfeMvcs. 

• Role sharing. Because we articulate several different kinds of skills that contribute to a 
particular kind of mathematical expertise, a pi von [Mobkm will require the completion of 
several activities. The principle of rnlo siKiiinv; >.ins that students generally will not ac- 
complish all of tiiese activities thciii.st- lvoN Instead, Uie tutor will share problem solving 
with the student by accomplishif^^; j specified subset of activities. 

In Uie following sci tiot).; ^vc bnctly show how different versions of our algebra tutor exemplify 
these principles while supporting the learning of mathematical tiiinking skills that art not 
c'.rrciulv part of most beginning algebra curricula in the United States. In addition, we also dis- 
K liss how Uie tutor versions are distinct in p*^dagogy as well as content. They embed assumptions 
about learning and leaching that are substantially different from those implicit in traditional di- 
dactic theories. 



Algebra Tutor Versions 

Tiie different versions of our tutor are most easily distinguished in terms of the "level" of 
the mathematical tiiinking skills they attempt to help students learn. The earliest versions of tiie 
tutor focused mainly on relatively "low-level" symbol manipulation skills, in contrast to higher- 
order tiiinking or problem-solving skills. (Sec Collins, Brown, & Newman (1988), and Schoen- 
feld (1985) for more discussion on tiie "continuum" of cognitive skills in maUiematics). 
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the Equation Solving Tutor 

The equation solving tutor was one of the the first algebra tutor versions we develov^ed. 
As the name implies, it is mainly intended to help students learn skills involved in solving simple 
symbolic equations. Tlie smdeni sees the tutor as a collection of windows and menus, shown in 
Rguie 1. The menus on the left allow the tutor and student to converse about reasoning and 
problem solving. To the right of the menus, on the bottom. Is the "work window," where the shi- 
deni creates each new line in his or her solution. New lines or reasoning steps can be created by 
selecting commands from menus (as in Figure 1). typing in algebraic expivs,s>or>,s> or wnUDg 
tiiem on an electronic ublet. To the right of the work window is the "cummeni wnidow ' where 
the tutor sends textual feedback to the student. 

The large window in the upper riphi is the "dispUiy window." where the student's reason- 
ing is fecorded and queried. ProbliMn bolvmy is represented here as a reasoning tree. Many of 
the menu items to Uic left s\v. ust^l lo manipulate the "nodes" in this tree. For example. "Explain 
Your Step" permits ihi- st\u1om lo point at parts of the reasoning tree done by the tutor and obtain 
justiflcatioas for the tutor's reasoning (sec Figure 1). Similarly, "Help Next Step" allows tiie stu- 
dent to obtain several levels of hints from the tutor. Using these options, the student can obtain 
nitixiiiant coaching and learning supports. 

Like AlgebraLand (Collins & Brown, 1987) and the Algebra Workbench (Richards & 
Feurztsig, 1988), tiie Wtor displays tiie student's work as a solution tree, tiius reifying the 
student's reasoning process by showing connections between steps. Each branch in the tree 
represents an alternate solution, or line of attack, on the problem. Hence a tree representation al- 
lows easy comparison of different solutions, both the student's and tutor's. Menu items like 
"Move Box" permit the tree to be exploited effectively: By selecting this item tiie student can 
move tiie site of activity in Uie problem solving from Uie current expression to a previous expres- 
sion or an expression on a different patii. They can then manipulate Uiis expression, question its 
justification, or ask for help as to a possible next step. 

The most important feature of this version is that it articulates and reifies different levels 
of problem-solving skills Uiat are necessary to solve symbolic algebra problems. We distinguish 
Uiree levels of skill here: goals - Uie abstract problem solving goals Uiat tiie student should adopt 
(tiie goals are shown in the menu on tiie upper-left comer of Figure 1). operations - tiie 
mathematical operations that implement the selected goal (tiie operations are sh^wn in the menu 
on tiie upper-right comer of Figure 1), and finally manipulation the application of an operation 
to create a new equation. It is our experience that classroom teachers are rarely aware tiiat sym- 
bol manipulation expertise comprises at least ihcse tiirce distinct skills. 

Consistent witii tiie principle of rcificaiion, each of these different layers of decision- 
making is made explicit. The student must make a visible decision at each of tiiese levels. In ad- 
dition to breaking out tiie different levels of decision-making, tiie tutor is also designed so tiiat 
each of tiiese levels of reasoning can be cither done by the student or tiie tutor, tiius permitting 
role sharing. In tiie environment shown in Figure 1. the student decides goals or operations but 
tiie tutor executes tiie chosen operation or goal and creates a new equation. 
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Figure 1. Interface of an equation solving tutor. 
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Model Building Tutor 

More recent algebra tutor versions focus on higher-level mathematical thinking skills. 
One motivation for recent versions is the obscrvalion that symbol manipulation skills are no 
longer as important as they once were for siudcnis to Icam. Why bother to teach a skill, so the 
argument goes, when it can be done faster and more accurately by a machine? For example, 
should students memorize multiplication tables when cheap calculators are readily available? 

The skills we have recently focused on fall under the general classification of model 
building. By model building skills we mean the ability to see how formal mathematical objects 
can relate to the real world; for example, how equations can provide powerful descriptions, or 
models, of the interactions among real-worid objects or properties. Consistent with the four prin- 
ciples outlined above, we can articulate model building into several related skills. They include: 

• Formulation, in a given real-world situation, involves determining which objects or pro- 
perties should be represented as mathematical objects. For example, in modeling the 
finances of a car wash to raise money to send the marching band to a distant competition 
one might decide that properties like the number of cars and the amount you have to spend 
on supplies should be variables in an equation that can be used to predict profit or loss. 

• Data gathering and representation represents a collection of related skills for collecting 
and examining information about values of properties selected during formulation. The in- 
tent of these activities is to understand empirical patterns of co-occurrence among vari- 
ables. For example, in the car wash situation, one might record tables of values and graphs 
showing how profit appears to covary with number of cars washed. 

• Translation involves positing a mathematical representation that captures the observed pat- 
terns of interrelations of the formulated situational properties. For example, in the car 
wash situation, translation may involve postulating an equation that relates the variable for 
profit to variables representing the amount spent on supplies, the fee charged per car, and 
so on. This skill is often referred to as hypothesis generation. 

• Inferencing or prediction involves answering questions about the situation at issue, either 
by manipulating mathematical representations that act as models for the situation, or using 
less formal techniques that manipulate data representations. For example, given a problem 
in which one must infer the required duration of exercise to achieve a given weight loss 
one can use an equational model for the situation or perhaps consult graphs and tables of 
values. This skill is related to hypothesis testing. 

Our interest in developing computer tools to help students learn model building skills stems not 
only from a personal belief in their imponance but also from NCTM curriculum reform effons 
(Thompson, 1988), and other related research (e.g.. Fey, 1984, Usiskin, 1985). 

Figure 2 shows the interface of a tutor version that provides coaching and passive sup- 
ports for various model building skills. In this version, the situation to be modeled is described 
verbally in the "siniation window" at the upper-left. Below the situation description is a ''word 
graph" where the student has enumerated ( formulated) a list of variables that relate the dependent 
variable, weight loss, to various independent factors. Using the word graph, the student can input 
values for selected variables. The tutor then computes the appropriate values for other variables, 
based on an underiying equation that relates the variables. The student's task, at this point, is to 
gather sufficient data to infer the underiying equation or model. 
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Figure 2. Interface of a model building tutor. 
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The environmem provide several tools lo help the student gather and organize dau. 
These tools include tables of values (lower-right), and cartesian graphs (upper-right). In addi- 
tion, the student is guided in his or her data gaihcrinjj by specific situations Oowcr-left). After 
students have a chance to freely explore varying values for variableSi the specific situations gen- 
erally constrain the student to explore covariation of pairs of variables. Here, the number of cars 
washed and the profit can can vary while the fee per car cost of supplies, and amount donated by 
business stay the same. The data gathered in this "constrained exploration" pcnnits the student to 
observe a positive linear relationship between time and loss. 

After such controlled explorations the student is usually in a position to specify the 
operators (*, A +i and -) that relate the vanablcs in the word graph, thus achieving translation. 
Equations are first represented as "word cquuiions;' which look like word graphs with operators 
connecting the "boxes" that represent variables. Next» symbolic equations arc computed from 
word equations by substituting letters for variable boxes (see Figure 3). Subsequently, students 
are given a series of problems about the topic, e.g.. "The band .sets the fee at $4.75, supplies are 
$15.00 and the donation comes to $75.00. The band will need to make 500.00 dollars to pay for 
the Rose Bowl performance. How many cars docs the band need to wash?" The students can 
then use their equational models to generate answers. It is at this point that the equation-solving 
tutorial software comes into play, coaching the student through the manipulations required to 
make the desired inference. 

The most important feature of tJiis version of the tutor is that it reifies each of the m^x\< j 
building activities mentioned earlier. We have already noted ilie various tools designed fur J.ua 
gathering and representation. In addition, fonnulation and translation activities are each associat- 
ed with their own graphic representations (word graphs and word equations, respectively). As 
with the equation solving tutor, the model building version also permits role sharing. Each activi- 
ty - including not only model building (formulation, data gathering, translation, etc.) but also the 
equation-solving activities entailed in solving specific problems (goals, operations, and manipula- 
tion) can be done either by student or tutor Indeed, we define "role profiles" that, for any par- 
ticular situation, stipulates which roles will be done by which agent. 

Pedagogical and Content Considerations 

The various algebra tutoring versions we have described depart from the curricula found 
today in U.S. schools. These depanurcs from how beginning algebra is traditionally taught in- 
clude differences in both content and pedagogy. 

In terms of content, three differences exist. First, in teaching topics that are part of the 
traditional curriculum (such as equation solving), we attempt to articulate levels of reasoning that 
are usually left tacit. Second, we also focus on topics (such as model building) that are not pan 
of current curricula. Finally, we arc attempting to connect topics that are part of the traditional 
curriculum with our newer topics. For example, the model building version of the tutor actually 
uses tlie equation solving software as a component. Equation solving is therefore not ignored, 
but neitlicr is it taught as a topic in i.solaiion. It is presented as an inferential tool; a means to an 
end and not an end in itself. In otlicr words, it is situuicd in natural contexts of use (Brown, Col- 
lins, & Duguid, 1988). 



f Algebraic Thinking Tdols 7 

1 <j • • 




Figure 3. Interface of the combined model building and 
equation solving tutors. 



o 

ERIC 



Algebraic Thinking Tools 



8 



Peitiaps deeper than Issues of conicni arc pedagogical differences between our tutors and 
traditional classroom didactic practice. Our upproach to helping students learn mathematical 
thinking skills differs ftindamentally from moiii classroom teaching principles. More importantly, 
some of our basic viev s on how students Icam appear contrary to prevailing assumptions. A 
simplified characterization of traditional classroom learning and pedagogical tenets might in- 
clude: 

{.Intensive practice. Individual skills must be practiced intensively if they are to be 
mastered. For example, if a student is to Icam equation solving, each of the skills involv* 
ing deciding on goals, operations, use of axioms like the distributive rule, and so on, must 
be exercised many times. This is a principle of learning that appears well-founded on 
many decades of research in cognitive psychology and education. 

2. Focused practice. Students cannot learn more that one or two new skills at the same time. 
For example, students should not leam how lo factor quadratics and solve linear inequali- 
ties at the same time. This also appears to be a well-founded principle of learning. 

3. Isolated practice. New skills should be practiced in a relatively "pure" fashion, divorced 
from related skills that are not familiar and also from wcU-leamed skills. For example, 
when learning how to solve simple equations, problems should isolate those skills and not 
elicit well-learned arithmetic skills (e.g.. the problem shouldn't have lots of "big 
numbers"). Although not "well-founded," one might regard this as a principle of learning 
or of "cognitive economy": Skills will be mastered faster if distractions are minimized. 

4. Bottom-up practice. New skills should be learned in a sequence that reflects a certain 
"logical" prerequisite ordering. For example, to solve an algebra problem you need to 
have mastered arithmetic and to do mode) building and make inferences using models, you 
need to understand the algebra of such models. Again, although not "well-founded" in 
research, this tenent is prevalent in most current instructional design. 

As obvious as these tenets might appear, we wish to argue that while 1 and 2 are correct, 
3 and 4 are not. We believe that isolated practice and bottom-up practice are often counterpro- 
ductive to useful learning and that they arc not logically necessary but rather only pragmatically 
expedient. This stems from the fact that, given the way classroom learning is now structured, it is 
unrealistic for teachers to consider interesting alternatives. 

An emerging view of learning that differs radically from traditional didactic theory is the 
model of situated cognition voiced by Lave (1988) and extended by Brown and Collins (Collins, 
Brown, & Newman, 1988; Brown, Collins, & Duguid, 1988). This view of situated learning sug- 
gests that individual skills only acquire their meaning when used in their natural context; that is, 
when they are used in typical situations and in conjunction with the other skills with which they 
usually interact. Such a perspective argues that isolated practice will result in skills that might be 
mastered locally but that will not transfer to ihc important situations in which they are naturally 
used. In response, a theory of situated cognition might suggest: 

3*Embedded practice. New skills should not be practiced in isolation. They must be learned 
in the context of realistic problems that elicit this new skill and all the other skills that typi- 
cally are needed to solve the problems. 
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Similarly, situated cognition argues that sequencing sicill acquisition In a bottom-up curri* 
culum hides the meaning of individual skills by prcscniing them in an order that may be ex- 
pedient but which obscures their natural contexts of use. For example, it might be argued that 
teaching equaiion-solving skills before skills involving their use as inferential tools imparts 
meaningless symbol manipulation abilities. ConscqucnUy, these symbol manipulation skills 
might have to be substantially releamcd when students are finally shown how they are used to 
model real-world situations. As a contrary tenet, a theory of situated cognition might suggest: 

4*Global-b^ore'local practice. Teach more global skills that allow the snjdent to forni a 
conceptual framework for a topic before teaching the skills for accomplishing local opera- 
tions. (See Brown. Collins, & Duguid (1988) for further discussion of this principle and 
related issues.) 

If one adopts the situated view of learning embodied in 3* and 4* the challenge then be- 
comes designing learning environments that permit such principles to be implemented. From the 
perepeclive of traditional didactic theory tenets 3 and 4 appear not only reasonable, but impossi- 
ble to circumvent even if one wished to. In tutoring algebra for example, how can we expect sm- 
dents who haven't mastered the basic skills of arithmetic to learn equation-solving skills? How 
can we teach students about the use of equations as models if they haven't already mastered 
equation solving? To add to the difficulty, .since wc have now articulated skills like equation 
solving and model building into several subskills, how can we expect students to get intensive, 
focused practice on any single skill if every skill required to solve a realistic problem must be ex- 
ecuted? 

Brown and Collins have begun to discuss new kinds of learning environments that 
respond to these challenges (Collins, Brown, & Newman, 1988; Brown, Collins, & Duguid, 
1988). The algebra tutors and tools discussed above represent our first attempt to provide such 
different learning environments. Note that by articulating and reifying skills and supporting 
shared problem -solving roles, we allow the student to obtain focused, embedded practice. For 
example, our "role profiles" can be set so the tutor does all the manipulation. This allows the stu- 
dent to focus exclusively on deciding which equation-solving goals exist at any moment in prob- 
lem solving. The student exercises only one or two skills at a time, but the problems do not have 
to be crafted to only elicit these skills. The problems can be as realistically complex as desired, 
since the tutor will supply the other skills, as needed. 

The same principles of articulation, rcilication. and role sharing enable global-beforc- 
local practice. For example, because the actions of setting goals, choosing operations, and doing 
manipulations can be selectively done for the student, wc have tested an environment in which 
the skills of manipulation are done for the student. Hence, they can can (and do) acquire algebra 
proficiency without mastering the symbolic manipulation skills. On a larger scale, we can also 
pemiit students to explore model building aspects of mathematics before mastering equation- 
solving skills. In some cases, we permit students using the model-building version of the tutor to 
explore situations and answer specific questions before they have received any training on sym- 
bol manipulation. To generate answers they either use skills such as approximation (using a 
graph) or table look-up (using a table of values); alternatively the tutor plays the role of the equa- 
tion solver. In both cases, the students see the value of equation solving in a realistic context of 
use. 
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In summary, along with Brown and Collins, we feel one key to providing powerful si- 
tuated learning environments is collaboration. When the many skills required to solve complex 
realistic problems are articulated they can become different roles that multiple agents share in 
cooperatively building a solution. We believe that one of the most potentially powerful roles the 
computer might play in education is that of a collaborating agent who shares problem solving 
with the student. 
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